New Method for Evaluation of Video Segmentation Quality

Segmentation is an important stage in image/video analysis and understanding. There are many different approaches and algorithms for image/video segmentation, hence their evaluation is also important in order to assess the quality of segmentation results. Nonetheless, so far there was little research aimed specifically at evaluation of video segmentation quality. In this article, we propose the criteria of good quality of video segmentation suitable for assessment of video segmentations by including a requirement for temporal region consistency. We also propose a new method for evaluation of video segmentation quality on the basis of the proposed criteria. The new method can be used both for supervised and unsupervised evaluation. We designed a test video set specifically for evaluation of our method and evaluated the proposed method using both this set and segmentations of real life videos. We compared our method against a state of the art supervised evaluation method. The comparison showed that our method is better at evaluation of perceptual qualities of video segmentations as well as at highlighting certain defects of video segmentations.